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ABSTRACT 

Performance assessaent procedures and a portfolio 
assessment fraaeworfc are presented for monitoring the language 
developnent of language ainority students in the upper elementary and 
midale grades. Unlike standardized achievement tests, 
performeuice-based assessoeilt can effectively monitor the progress of 
language minority student? because it can fje conducted on an ongoing 
basis. Portfolio assessment has the potential for becoming an 
effective management system for performance assessment results. It 
can be conducted on a classrocMa, schfx>l-*ride, or district-wide basis. 
This rei»rt contains two mam sections. The first discusses 
performance assessment, covering purposes, types, design, 
administration, and scoring techniques for oral language assessment, 
reading assessaent, writing assessment, aneaaotal records, and 
self~assessment for language proficiency ani learning strategies. A 
sample literacy develoi^ient checklist and a chart showing sample 
holistic criteria are provided. The second section reiK>rts on 
portfolio assessment, including the follcwings lesigning portfolios 
(e g, purpose, specific focus, |»rfor»ance task, instrument selection, 
setting criteria, staff collatwration, stf.ff development, student 
selection, and student/parent involvement); planning for and 
collecting the data; analyzing portfolio contents; using portfolio 
results; and sane common concerns alxsut puttiny portfolio use into 
practice (e.g., time requirements, content interpretation, ways to 
use portfolios and performance-based assessaent) . Sajnple contents 
from reading/writing portfolios in Virginia, New Hampshire, and 
Florida are summarized in a one-page chart. Contains 68 references. 
(LB) 
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Introduction 

Well-ilesigned assessment procedurcs are esvsential to meeting the needs of language minority 
.students squiring English as their second language. Assessment is involved at many steps in a 
continuum of servkes for these students: in initial identification, in the placement of students 
into approjMiate instnicticMial programs, in mcmitOTing the progress students make within these 
programs, in i eassigning students to different levels wi^n a program depending on their 
growth in English langua^ skills, in moving students out of ^secial {m)grams and into main- 
stream classes, and in following the pn^ss of these students in the mainstream. This continu- 
um is vhoUy dependent at eiKrh step on the appropriate selection, use. and interpretation of rela- 
tively ctMTiplex assessment pnocedimcs. 

Backgnnind 

Recently, there has been a gajwing interest among mainstream educators in performance 
assessment due to concerns that multinlc-choice tests, usually tlw only oiHion available finom 
lest publishers, fail to assess higher order skills and other skills essential for functioning in 
school or woric settings (Haney & Madaus, 1989: Neill & Medina, 1989; O'Neil, 1992: Wig- 
gins, 1989). Multiple-choice tests are not authentic because they do not represent activities stu- 
dents typically perform in classrooms. In additicm, multiple-choice tests do not reflect current 
theories of learning and cognition and are not based on abilities stuctents actually need for future 
success (Herman. 1992). Another concern is that standardized tests cannot be used to closely 
monitor student progress in the school curriculum throughout the year since they arc only ad- 
ministered once or iwicv annually. These concerns arc no less valid for educators of language 
miniMily students. 

Purpose and Definitions 

This publication describes perfomiantv avsessmcnt priK-edures and a portfolio assessment 
framework for monitoring the language development of language minority students in the upper 
elementary ami middle grades. Pertbrmancc and portfolio assessment may also be used to nKct 
crthcr purposes, such as reassignment or reclassificaiitHi. as determined by teachers or other 
sch<K)l staff. Although assessment of student progress in the ccMitent areas merits description and 
critical iuialysis, examples of periomiance assessment procedures provided here are limited to 
the monitoring of English and/or native language development. We begin by defining basic 
icnr to be used throughout this publication: alternative asscssn^^nl. perfonnance assessment, 
and poftfoliti asscssmcnl {Baron, 1992a; Sliggins. 1987; Tiemey. Carter, & Desai. 1991 ). 

Alternative assessment: 

• is any nvrihtxi of fniding out what a student knows or can dt) that is intended lo show gro\\ th 
and inftmii instruction and is not a standardized or traditional test: 

• is by definition criterion-rcferencxxi; 

• is authentic because it is based on activities thai represent actual progress toward instimiional 
goals and reflect tasks typical of classrooms and real-life settings: 

• axjuires integraticMi of language skills: and 

• may inclutk? teacher observation, performance assessment, iuid student self-assessment. 



Peifinmatux asset^mnt: 

• is a type of altranative assessni^*t; 

• is an exercise in which a student demonstrates specifK; sluUs and competencies in relation to a 
continuum of agreed upcm standards of profickncy or excellence; and 

• reflects studmt performance on instructional tasks and relies on professional rater judgment in 
its design and inteipretaticni. 

Partfolh a^ssment: 

•is the use of records of a student's woik over time and in a variety of modes to show the depth, 
breadth, and development of the student's abilities; 

• is the puiposeful and systematic collection of student work that reflects accomplishment rela- 
tive to specific instructional goals or objectives; 

• can be used as an ^jproe^ for combining the infomiation from both alternative and standard- 
ized assessments; and 

• has as key elements student reflection and self-monitcMing. 

rerfiMinance assessment and ponfolios are onnplementaiy a]:^Hoaches for reviewing stu- 
dait lixnguage ctevelopment and academic progress. Tog^her they represent audientic assess- 
ment, continuous assessment of student pn^ress, possibilities for integrating assessment with 
instnicden, ass^sment of teaming processes and higher-onkr thinking skills, and a collabora- 
tive approa jh to ass^sment that enables teachers and students to interact in the teaching/learn- 
ing process. One of the advantages of using performance and portfolio assessment with lan- 
guage minority students is that the assessment can be conducted in the students' native language 
(0'Malley& Pierce, 1991). 

Portfolios have been most widely used in the te^hing of reading and writing, with a strong 
focus on classroom instruction, student ownership and self-evaluation, and teacher autonomy 
(Graves, 1983; Ticmey, Carter. & Desai, 1991 ). More recently, portfolios have been proposed 
and adq)ted as statewide student assessment management tools in addition to or in.<^ead of stan- 
danlized achievement test data (Baron, 1992b; Brewer, 1990; O'Neil, 1992; Rothman, 1991 ; 
\femiont Slate Department of Education, 1990). Provicfcd that the |Hirpose of portfolio contents 
is to expand understanding of a «mident's growth based on multiple meiKures, different kinds of 
test and non-test data can be included in a portfolio. Rmfolios might also contain re(]uired infor- 
mation for state- or district-wide systents, but these data need not dominate or divert portfolio 
assessment from being used to inform classroom instruction. 

Pcrfonnance assessment and portfolios are typically seen as sources of tesKrher and student 
empowennent because control over assessment shifits from the administrators to those linked 
most closely to insumtion (Graves, 1983; Tiemey, Carter, & Desai, 1991 ). While we believe 
this shift of conirol over assessment is a positive one, we also believe that the most aseftil kind 
of assessment is that which can be shared with other teachers who interact or will interact with 
students. For this reason, we emphasize systematic approaches to asscssn«nt which can ensure 
the reliability and validity of the results. 



Performance A^essimnt 

Performance assessment falls into two cate^jries: sdiievcnient-related behaviors exhibited by 
the saident (e.g., communicatiwi or reading skills) and achievemaii-related products that 
students develop (e.g., written reports or projects), ftrfomiance assessments require that the 
assessor 

( 1 ) observe the behavior or examine the prodiKt that is reflective of achievenKnt, and 

(2) apply clearly articulated pcrfcMmance criteria so as to make a soumi (Mofessional judgment 
rcganiing the level of proficiency demonstrated Intuitions, imj^essions, and **fcelings" about 
student performance are /lor a part of sound performance assessments, like paper-and-pencil 
tests, performance assessments must adh^ to certain mles of evidoKC (Stiggins, 1990). 

In this section, procedures are provicfcd for the design of performance assessment tasks and 
instmments that can be included in portfolios of langua^ minority stucfents and chiWren learn- 
ing English as a non-native language. Procedures for assessing specific language skill areas 
(oral langua^, leading, and writing) and flieir integration arc described. Suggestions are also 
provided for designing stuctent self-assessment n«asures of langua^ proficiency and language 
learning strategies. Each catcgoiy betow includes brief descrifHions of types of assessment pro- 
cedures and ways to design and administer perfonnance tasks, with particular attention to the 
developn^nt of appropriate scoring procedures. Eash assessment technique should be adapted 
as needed to match the developmental and language proficiency levels of the students. This can 
include assessment in the siutfents' native language. 

Oral Language Assessment 
Purpose/Types 

To determine oral language comprehension and production, teachers can administer perfor- 
mance assessments which reflect tasks typical of the classroom or real-life sett-ngs. In this way. 
assessment is authentic and aligned with both the curriculum and students' prior experience. 
Oral pcrfomiance assessments are not limited to a single type and can take various forms (k- 
pcnding on their authenticity in relation to classroom activities. These can include: oral inter- 
views, story retellings, simulations/situations, directed dialogues, incomptete story/topic 
pn)mpts which students are asked to complete, picture cues, teacher observation checklists, and 
student self-evaluations (Bachman & Palmer. 1989: Gonzalez Pino. 1988: Omaggio. 1986: Os- 
carscm, 1989). 

Design/Admimstration 

A major d)stacle to conducting oral language assessment in the classnxHn is the time in- 
volved in administering the as.sessment to students one at a time. Alternatives to individual stu- 
dent assessment in laige classes inclucte the use of teacher observation checklists and the assess- 
ment of pairs or small groups of stuitents at oi« time (Fox & Allen. 1 983: (knishi. 1985: 
Gonzalez Pino, 1988: Pinnell. 1985). 

To conduct assessment in pairs, leacters can use l ue canh and ask stuctenis to interview 
each other or to interact following the directions on the cue cards (Gm/jakz Pino, 1988). Cue 
cards should be written at the reading level of the students to be assessed. In order to have 
enough oral language production to assign a rating, at least five or six sentences should be 
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elkiied fnmi each student Oie caids can eisUy be 

called prompts, on index cands to elicit the perfomuuice teachers wish to assess. For exani|)le, if 
a lesson has just been oxnducted on personal greetings and l^ve-takings, one student's cue card 
might read, "Greet yotn* classms^ and find out where he or ^ has been for the past few day&'* 
The other cue card could rcMl, "Respond to your classmate's questions by telling him « 
you have be«i at home sick. Bnd out tiom yourclassmaie w}»t you have missed in class." 

Depending upon the a^ and language proficiency levels erf" students in the class, teachers 
can use picture cues or topic numalogues to conduct individual (Hal assessments. To use picture 
cues, the teadiCT pesents lectures or phcMographs appiupriate 

the students being assessed. From among several pictmes die teacho- presents, students can be 
asked to choose one or two pictures that they feel they can talk about The teacher can lead the 
student into talking by askmg que^^ions such as "What story does this picture tell? Has this ever 
happened to you? What do you think will happen next?" 

In using topic monok)gues, the teacher provides a topic for the student to address at length. 
This is an authentic performance ta^ for upper elementaiy and middle school students who are 
often asked to present oral reports and syntheses of what they have read. If a lesson has just 
been presented on foods to students at an intemiediate level of English proficieiKry, for example, 
a lopic monolt^ue such as the foltowing might be apprc^ate: *Tell me about your favorite 
food Describe it and tell me why it is your favorite." For more advanced stuctents, the topic 
might be: "Give me the recipe for your favorite food." 

St(»y retelling is an eflfetiive way to integrate oral and written language skills. Students 
who have just read or listened to a story might be asked to retell the story or to summarize the 
main idea. When pictures, topic monologues, cue cards, or story retelling techniques are used, 
instead of the typical interview pattern of teacher-qiKslion/student-response/teacher-quesiion, 
teacher talk is reduced and more time is allows fw shident language production. 

Teachers may also want to a.ssess students' ability to use i^ademic language. Academic 
language is the cognitively demanding and contcxtually-reduced language of content area in- 
struction and is cTittcal for success in maiastream classrooms (Cummins, 1982; 1983). Academ- 
ic language functions arc the essential communication t^s that students must be able to per- 
fomi in different content areas; they determine whether the learning task will be simple or 
complex (Dix, 1992; O'Malley & Chamot 1990; Pinnell, 1985). For that purpose, teachers can 
identify specific language fuiKtions that arc germane to an instructional goal or activity 
(O'Malley, 1991), such as: 

•Seeking infomuilion 

Using language to explore the environmcnl or acquire information (e.g., using who, what, 
when, where, and how lo collect informatii>n); 

•informing 

Reporting, explaining, or (Ascribing information or pnwjdures (e.g.. retelling a story, tell- 
ing the main idea of a reading jxissagc. summarizing); 

•Analyzing 

Separating a whole into its parts (e.g., telling parts or features of a concept, a procedure, an 
wyect); and 



•Emluatinf* 

Ass^ing the worth of an object, q^inion, or deciskNi (e.g., sekcting or naming criteria to 
evaluate, prioritizing a list and explaining criteria, indicating reasons for agreeing or dis- 
agreeing). 

Scoring 

Teachers and/or raters shcmld establish scoring criteria for a range of grade levels (e.g.. 
Grades 4-6« 7-9) and identify at least three cate^Mies of proficiency: non-EngUsh profk^ 
(NO'), limited English {HoficieiU (LEP), and fluent Eriglish proftcient (FEP). Because these cat- 
e^»ies were originally intended for identificatk)n and placement puiposes and consec^iently 
tend to be broadly ckfined, for the puiposes of monitoring audent language development it may 
be useful to differentiate bands of profk^ncy within each level, such as low, intermediate, and 
high. This will enable the teacher to design instruction more appropriate to ^wfents' needs and 
to monitor growth from one band to the next within levels as well as frtHn level to level. 

Scoring criteria should be holistic, with a focus on the student *s ability to receive and con- 
vey meaning. Holistic scoring procedures evaluate performance as a whole rather than by its 
separate linguistic or grammatical features. Depending on the goals of instnicti(m, grammatical 
accurscy and pronunciatkm tray not be as imptnlant as skills critical to comfHehemiing and 
conveying meaning. Students are evaluated by using detailed criteria or definitions of perfor- 
mance matched to a rating scale (Hamayan, et al., 1985; Navanete, et al., 1990). 

Tearhers wanting to score grammar and pronunciation may wish to treat these as subsctn^ 
md assipt them weights which are less than Hie weight assigned to a subsoxre fcM* overall 
communicative ability (Hanmyan, 1985; Gonzalez Pino, 1988). Well in advance of the oral 
assessment, students should be provi<fed with an explanation of how they will be rated. If 
teachers (Han to a«»ign a gnute to the wal asse&sn^t, they will have to (tetenniiK the setting 
range which cxnresponds to specific letter grades at each grade level. 

A holistic oral proficiency rating scale that tejK:hers may want to use is the Student Oral 
Proficiency Rating (SOPR). The SOPR is a matrix (adapted from the Student Oral Language 
(X>servation Matrix/SOLOM developed by the San Jose Unified School District, California) 
which allows for rating students in five categ^ies of oral language proficiency: comprehension, 
fluency, vocabulary, pronunciation, and gramme (see F^nre 1). Within each categoiy, students 
can be rated at five different proficiency levels. The ratings for each category are considered 
separate sub-scores, ^h ranging frrm 1 to 5, with 5 imiicating tl^ af^SDximate level of 
proficiency for a native speaker. A total score results when sub-scores for the five categories arc 
combined (Develc^mient Associates, 1988). 

Reading Assessment 

BerfOTimiKe assessment of imling with stiKlents who are learning &iglish should focus 
on reading cfMnprehension rather than isolated reading skills, as is typical of many standardized 
achievement tests. We suggest four af^iwxjachcs for the assessment of reading that have been am- 
ply dsxnibed in the lit»^ure: miscue an^ysis (Ckxxlnian & Bailee, 1972); Ibe individual read- 
ing inventory (Cunningfiam. et al., 1983); anecdotal records (Goodman, Goodman, & Hood, 
1989; Rho(ks & Nathenson-Mejia, 1992); and daze tests (Cohen, 1980; Hamayan, et al., 1985; 
Madsen, 1983; Oiler. 1979). One additional approach which has not been adequately described 
in relation to the imling behavicHis of language minority stuctents and which we describe below 
is the u.se of rating scales. 



Fi{^re 1. Student Orui Profkjency Rating'*' 

^wbat^s Nairn Grade LmfflageObservea 

S(Aool Oty ^ 

Rated by l^te 



DIRECTIONS : For e»:h itf the 5 cate^iries b^w at the left, mark an ''X'' across the box that be^ describes the ^crt^s abilities. 



CATEGORY 


LEVEL 1 


LEVEL 2 


LEVEL 3 


I 1717171 4 

LEVEL 4 


1 171/171 C 


A. Comprehensbn 


CtniKsi itfider^^ even 
conveni^ion. 


Iksf^diffkuky f(H- 
kwing wh< is Noki. 
om^HdieiH] only ''social 
cmtvmsaton" ^>okai ^mly 
mi with fieqti^ repmicms. 


UtKier^^mb mos d \ s 
said at slow»'-tlw.iii>n!ia} 
!4)eedwith lepetiiions. 


Uixler^aiMb nearly ev«y- 
thmg at mmi^ speed, 
aldmt^ ocr»sioi^ repeti- 

um my h: \tc icfmy. 


Und««m(k everyday 
convovition aiKl n«nial 
dassroon dlscussk)ns withcMU 
difficulty. 


B. Fluency 


Speech is ko tdting and 
fragn^ntiffy as to ntaks 
it»iv^s^ion vbtually in^sibk* 


U^ly hcsitatf; often (moA 
htf 0 ^teiKX by boigu^ 
limitaiitms. 


Sp««d! in everyday con! 
iminkratim mA cl^nmom 

is frcqi^emiy 
dmipled by the stiMten's 
seaitii for the OHtecf nmnmr 
exf^smi. 


Spe^ m everyday com- 
nmnictton smd cbssrom 
db$ai5^ is gcnetilly fluem^ 
with occ^onal wluk 
tte sRKto searches for the 
cTffn^ manno' eiipie^icm. 


Speech in ev^day c(Hiver- 
stticmaffiimclassmcmi 
dbcusMom k fluent and 
cfTtmlesi, afpoxhtfiding ih^ 
(rf a mSm speaker. 


C. Vocabulary 


VocalHibBy limitMiomi are so 
e?(Utme » to make conveniaimn 
virtually impo^bkr. 


Misuse of woitk and very 
limited voc^ky m^e 
ciMipehemimi quite difficyh. 


Beqtmitly uses the wrmg 
wc^; ccmvo^mism^ 
whm limited because 
ii^tefuale voc^i^. 


Ocaskmidly uses 01^^ 
lenns c^- nnisi re^H^ 
bec^se of imm^ate 


Use of voodwlary ami kKoms 
iq^xinviaes th^ a miive 
f^Teaker. 


D. Pronunciation 


PrumiiKriatk^ {^diiems so severe 
as 10 make speech virtually 
unintelligible. 


Very totl to uiKto^siHl 
because ^ms^mm 
ptckkm. Mu!^ freift^tiy 
nepeat in <Hifer to be 
uiKterstood 


f^(^<dt^ cofK:eittrtf ion cmi 
the {Mt of fhe limner ami 
oa^askmaliy ted to 
misunderstanding. 


Always ii^ligil^, ttmi^ 
one is oM^iws of a definite 
acceiti ami axasimal 
in^7{m^i^ inttmaticwi 


PnMHmcialicMi mtd imcMiaiitHi 
af^ximate a native 
spier's. 


E. Grammar 


EfTors in granmar ^ N%t«d cmJer 
s(9 scveit as to m^e spct^i^ 
virtidly unintelligible. 


Granmar ami word onfef 
errm make d^rqirehension 
diiftcuh. Nfusi r^^^ 
rcjirict what is said to b^ic 
patterns. 


Makes fn»p^ errors of 
gnunmar ^ wofd (Mder 
which oor^imalty t^nire 
meaning. 


(Xcsbiiimally m^es 
gramnurticid en* w<^ imler 
erropi which do mil trfhcure 
n^anhig. 


(ir^mnatical us£^ ami woid 
(mler ^[miximate a nMive 
j^jeaker's. 



^TlNs form is m ada^tkm of Ifae Stadeiri Oral Ullage Observitfioii Matrix (SOLOM) de^vtoped by the Han Jose (Cilifoniia) I nifirj School Dtslrid. 



Adi^ed by De^ttopment Asiocates. Inc^ Arliogtofl, Virgiaia, and used wiUi pernk^on. Signature of rater 
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Purpose 

Rating scales can be used to collect information on a range of student reading behaviois. 
Rating scales offer several JMlvaniages: they arc systematic, require little teacher time, and do 
not disrupt instructional time. A rating scale is a tHiecklist that contains predetermined perfor- 
mance tasks and a systematic (nocedurc for indicating a student's level of perfomiiance relative 
to specific criteria. The number of levels in the criterion will be determined by the focus of the 
assessment, but ead\ will be precisely defined. 

l}esign 

Four types of informatii>n teachers can maintain in usinc a rating a'ale for reading comfMic- 
hension arc reading skills, interest, applicatioas, and reading strategies. TejKrhen^ can collect in- 
formatiim as frequently as is aHisidered a^m^ate to the puiposes of assessment awl insimc- 
tion. For example, occasional ctecks on student progress could be conducted biweekly, 
monthly, or quarterty. although other options are also possible. 

The assessment of tvaJing skills is designed to reflect the stutfcnt's ability to perform func- 
tional reading tasks. Although tci«:hers can select their own objectives depending on liKal cur> 
riculum framcw(Mlcs in language arts, scnnc possible ob^ctives are reflected in Figure 2. Com- 
prehension of stories read aloud cm be cxpamted to incliKie literal and inferential 
comprehension, if desired TcA:hers can determine if students have fluent dcctxiing skills by 
asking them to read aloud individually and by checking comprehension through probe ques- 
tions, such as "What was the main icfca?" and "Whit do you predict will cxxur next?" 

One of the major concerns in reading assessment should be a student's /nW ofintetvst in 
reading materials. This interest can be shawn in the variety of materials independently selected 
by students. The applications category reflccis intcgraliw of speaking, reading, and writing 
skills. Applications may include a project, such as writing and presenting a skit, producing art- 
work, writing a paper, keeping a reading log m the kinds of materials read and how often they 
arc read, or paxlucing a self-repi>n on reading ability. A tc«:her narrative or rating scale cinild 
be used to assess student progress in each of the categories listed in Figure 2. These catcgcKics 
shtiw what students can actually do with reading materials and how they use them to achieve 
their own purposes. 

A fourth possible category for rating stales is the students' use of /v<it//>i.i? sfraU'}»ies. Sub- 
stantial evidence indicatc»s that students wh4> use reading strategies compreliend text nK>rc effec- 
tively than students who do ml (e.g.. Dole, Duffy, Roehler, & Pearst>n, 1991 ; Prcsslcy, 1990), 
and that students from language mim?rity backgnninds also benefit from the use of these strate- 
gies (O'Malley & CTiamt^, 199(n Patlron & Waxman. 198X). Used in amjunclion with miscue 
analysis, reading strategies assessment can reveal what kinds of strategies, techniques, or ap- 
pn)aches students use to understand and renumber inftmnation tlury have read, what Uiey do 
when they lue given a remling assignment, ami what they do to unctenitand and nmrmher what 
they have read upon completing a reading passage. Strnie sample questions for detennining 
reading strategies (modified fn>m GiKxlman, Watson. & Burke, 1987) are: 

1 . WlTcn you ;irc reading and c<mtic tt) stmK'thing you don't kmiw. what do you do ? 

2. Who is a gixxl reader ytni know? What makes that perstMi a gtxxl reader? 

3. If yiHi knew somet^ne was having trouble reading, how winikl you help thai person? 
What would ytnir teacher do to help that perstMi? 

4. WhiU would you like to do better as a reader.' 
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From these kinds of questions, and from probe questions asked during an individual read- 
ing tnvoitoiy, teachers may be able to rate student p^foimance relative to the strategies indicat- 
ed in Figure 2. 

Teachers can cdtect infonnation on reading skills using a rating scale white observing stu- 
dents individually, in pairs, or in small groups. Ratings for s^iecific skills such as literal and in- 
ferential ccMnprehensicHi could be based on probe questions asked of stiKlents following a silent 
leading exercise. Probe qi^stions shouki reflect diffoent levels of cognitive comptexit/, such as 
the following (Maryland State Department of Education, n.d.): 

•Krum'ledge 

Who was die main perscNi in this text? Wl^re did tl^ event take place? 
•Ctmprehension 

What was the main idea of tlK reading? Retell what you have read in your own words. 
•Analysis 

What are the parts or features of .? How does compare with ? Out- 
line the components of . What evidence supports ? 

•Synthesis 

What would you predict will occur next? What ideas can you add to What 

would you suggest is a solutiim for ? 

•Ewliiation 

Do you agree with the statement that ? Prioritize accwding to . 

What CTiteria wcmid ymi use to assess ? 

The questions at each level of cognitive cxmiplexity can vary in the demand they place on 
Engli*^ language (nDficicncy. Fch* example, at the ccmi{^tK;nsi(Hi level students can mxm the 
main idea of the stoiy either orally or in writing by selecting frwn among a number of alterna- 
tives or by generating the idea on their own. At the evaluation level, stucfents can prioritize a list 
or provide criteria for the evaluation of an idea and write sentences indicating their assessment 
of a concept. Thus, students can he assessed for their ahUity to rr-.v/^ri/K/ to higher order ques- 
titms even thou^^h they may hm e minimal skills in English. 

Scoring 

Sccning criteria siwuld focus on the krvel of student pcrtormance relative to a standard. 
The teacher can indicate student perfcKmance as being effective, sontetimes effevtive, or need\ 
work, as in Figure 2. Another option is to indicate a student's ability to perform at three levels: 
ifuiependently, v%'ith assistance, or dtfes not perform task (Vygotsky, 1978). Below is an excerpt 
taken from a rating scale on reading cx>mpreheasion. In this rating scale, a teacher cx)uld rate 
student perfonnance in literal and inferential cmiprchension at the three performance levels as 
follows: 



r ■ ■ 

Reading Tasks 


Criteria 


hukpemivnily 


With assistam e 


DiH^s mn do task 


Understands literal meaning 








Draws inferences from reading 









1 ^ 



Student. 
School _ 

MARK: 



Academic year 



Effective 



T] Sf»ii^iiies Effective Q Needswork 



ReaM^ Processes 
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2 1 


3 1 


4 


r. Kr \tM\(. ^Kli 1 ^ 1 


Comprdiends ofBl sti»^ 










Reading vocai)uiary 










Ruent decoding 










Literal comprehension in reading 










Inferential comrae^mion 














Initiates o«ti reading 










Shows pleasure in reading 










Selects books imiependently 










S^nples a vaii^ of iiMtfcrials 










Ilk M'lM It Vlh)\^ 


Participates in language experience story developmrat 










Participates in reading discussicMi groups 










Writes appropriate dialogue journal entries 










Chooses books of appropriate difficulty 










Uses reading in written ccminiuniattion 










l\ , KI ^ 1 K \ 1 ^ 


Monitors attention 










Notices miscues that intcifere with meaning 










Infers meaning based on: 










Word clues 










Sentence structure 










Story structure 










Prior experience 










Summarizes main ideas or key events 










Links details to main ideas 










Remembers sequence of events 










Predicts conclusions 










Requests help if needed 











ERIC 



*/jLptedfnm materials dextUtped by the NaticuJ Lo" nil .)f Teachers of English ami hy The Writinfi Lab of the 
Univeniiy tif Ne*i' Hampshire. 
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Writmg Assessment 



Furpose/Types 

An assesanent of writing provideji an tndicaticMi of how well students communioiti: in the 
wri!^ language. Teachent can deteimine imident progi^s in writing dirough direct measurcs of 
functional literacy, such as writing samples, process writing, and dialogue joumaln. Writing 
san^)ies are the mo&t commonly used perf<^inance assessment of writing ability and will be de- 
scribed fiirther. 

To oMistnict a writing sam]:^, the following steps are reaMTjnciKted: 

( 1 ) Select writing prompts that arc developmentally appropriate. Use prompts that will 
elicit writing tiom students on topics that are familiar and interesting to them and that reflect 
writing styles commonly practiced at their grade level. Writing prompts should not depend upon 
a >4udent's knowledge of a ctmtent area. 

(2) Provide a choice of topics. By giving options, teachers increase the possibility thai stu- 
dents will be intenested in and capable enough to select one of the topics and write on it (Hamp - 
Lyons, 1990; Reid, 1990). However, because the sccMing of writing samples may differ depend- 
ing on the genre, the topics provided in a single assessment should be limited to one genre, 
preferably one to which students have alrefKly been exposed Representative topics may differ 
by grade level and can include autobiographks, biographies, shod stories, reports, and critical 
analyses. 

(3) Check the topics for cuhural b: is. If the topics consistently assess knowledge of a par- 
ticular culture rather than of the English language, they are probably culturally biased. Writing 
prompts may address relatively neutral themes, such as asking stiKients to describe a favorite 
relative. Alternatively, they may inclutfe more controversial topics designed to provoke students 
to take a position, such as students' attitudes toward violence in school. Topics can be checked 
for bias with cultural informants (other school staff or parents) who share or have experience 
with the culture of the students. 

AdmmstnUion 

Give ciear directicms. Stuctents shouki know the amount of writing required, how much 
time they Ivive to write, ami how tl^ir writing will be sccmi. A minimimi of thirty minutes 
should be provid \ to allow students to plan, oiganize, and revise their woik. A minimum of 
two paragraphs shouki be required of students. Decide whether students can use dictionaries or 
other resource materials during the writing process and af^ly this mle consistently. 

Scoring 

In preparation for d writing assessment, students should be told what the scoring criteria 
arc, be given moctel papers Jiat illustrate the range of scores assigned to writing samples, and be 
provided opportunities through cooperative learning grtnips to discuss their work-in-progress 
relative to the scoring criteria (Kolls. 1992). Students shouki be given opportunities to re-wrilc 
their products after receiving feedback from scoring. 

Scoring writing samples of itudenis in various grade levels n^ans developing criteria lo 
apply to difiienent krvels and determining what scores mean with regard to student progress. At a 
minimum, at least three categories slmuld be established within each grade and level of English 
language proficiency with regard to writing ability: low, intermediate, and high levels of 
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writing. Rh- example, a stucknt might be a high leve! writer at an imemiediate tevcl of profi- 
ciency fw jaxth-graders. 

To scwe a writing sample, use IwUstic scoring criteria which focus on the communicative 
nature of the writing (see F^ire 3). Other qidons include assignii^ relative weights to overall 
fluency, oiganization, mechanics, ami grammar. Depending on ti^ 
may want to assign lowar weights to language conventions (e.g., mechanics and spelling) and 
higher weights to expression (coherraice, effective nanative strategies) in ofder to encourage 
students to communicate freely through writing. 

The most relialde way to sc«nc writir^ samples is to allow at least one other teacher or staff 
member to score the sample separately, after both raters have discussed and agreed upon the 
scoring criteria and have olHained similar scores on a few writing sani{^. Raters need to estab- 
lish consistently high interrater agreen^nt levels with regard to the apfst^iriate classification of 
each student but not necessarily with regard to exact scores. A minimum interrater agreement 
tevelof80% is recommentkd. This means that two teachers rating a samf^ of student papers 
should agree on the oveiall rating for at least 80% of the auctents (see Figure 3). 

Significant differences in the clasiifkation of students require negotiation, clarification of 
the scoring criteria, and, perfiaps. re-scoring the writing sample. If differences persist, then raters 
s^iould look at other evidwice of stwient writing in order to determine progress and decide 
whether a student should be fAaxxd at a higher or lower level of imtruction. The usefulness of 
the writing sample depends upon the quality of the scoring piocedure used and the (kgnee of in- 
terrater agreement established. 

Anecdotal Records 
Purpose 

Anecdotal records are notes based on teiM:her observations of how students learn. They can 
be used to determine a student's integration of reading and writing processes. The open-ended 
nature of the anecdotal record allows te£tt:hers to describe in rich detail each student's develop- 
ment in literacy, to integrate these observations with c^her available information, and to identify 
instructiimal apprwiches that may be appropriate (Rhoctes & Nathenson-Mcjia, 1992). 

Design 

Anecdotal records car be produced by following three guidelines: 

( 1 ) descTibe a specific event, process, or product; 

(2) report rather than evaluate — save interpretation for later, and 

(3) relate the material tc other known facts about the student. 

AdmimstnUhn 

Snidents can be observeo while engaged in teaming activities which produce the behaviors 
to be assessed. In cxmipleting tl^ anecdotal record, the teacher will descTibe the specific learn- 
ing event and what the student actually did in that simation. For example, eachers may develop 
anecdotal records of aciKlemic language skills by observing stu<fcnts as tbcv work on math word 
problems in cooperative teaming activities. Students may also be iibserved and asked appropri- 
ate questions while reading aloud in order to deteimine their level of resKling comprehension on 
different types of materials, hi ^tion to obser\ ations, teachers can review stiKient products as 
a means of developing anecdotal recxMxis. For example, teachers can keep anecdotal records on 
student writing samples to document progress in literdc*y. 



Figure 3. Samfiie Hofistic Criteria 



Rating 


Criteria 


5 


» Vocainilary is precise, varied, and vivid 

• Oi^anizaticMi in apprqiriate to writing assignment and contains clear 
introduction, development of ideas, and conclusion 

► Transition from one idea to another is smooth and provides rea(ter with clear 
understanding that t(^ic is changing 

• Meaning is conveyed effectively 

• A few mechanical errors may be present but do not disrupt communicaiion 

> Shows a clear understanding of writing and topic development 


4 


• Vocabulary is adequate for grade level 

• Events are organized logically, but some part of the sample may not be fully 
developed 

• Some transition of ideas is evident 

• Meaning is conveyed but breaks down at times 

• Mechanical errors are present but do not disrujH communication 
» Shows a good understanding of writing and topic devek^nnent 


3 


• Vocabulary is simple 

• Organization may be extremely simple or there may be evidence of 
disorganization 

• There are few transitional markers or repetitive tr^sitional maricers 
> Meaning is frequently not clear 

• Mechanical errors affect communication 

• Shows stHiie un(terstanding of writing and topic development 


2 


» Vocabulary is limited and repetitious 

• Sample is comprised of tMily a few disjointed sentences 

• No uansitionai markers 

• Meiuiing is unclear 

• Mechanical errors Cituse serious disruption in communication 

• Shows little evidence of discourse understanding 


1 


• Responds with a few isolated words 

• No complete sentences are written 

• No evidence of concepts of writing 


0 


• No rcsptmse 



Suun e: S. 5. A' Exaluaium Assistam c Center iEAC> Eau. Otifrfftttmn Univcrsify. Wushinxhm. D C . /VW^. 
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Scoring/Inierprekition 

The uitei|Htetatkni of anecdt^ records relies osi teacher judgment radier than nummcd 
scores. The teadier reflects on the meaning of the student's paicsmance relative to instructional 
gcMils and activiti^ and othor infonnation availaMe on the studoit. Through anecdotal records, 
observaticms ctf students can be compared with infcmnation obtained from otho* assessn^t 
sources, such as reading com{Mehension tests and writing samples, and reccMnmendalions can 
be made for adapting instruction to student needs. 

Self- Assessment: Language Proficiency 
Purpose/Types 

Self-assessment is an essential annponent of alternative assessment. Self-assessment en- 
ables snjdents to reflect on their learning activities, ta^ mxMnplishments, and {KOgress in lan- 
gu^ devel(^)mcnt and other ar^ of instruction. Snidents see tangible evidence of teaming 
when self-assesanents are ccntducted periodically throughout the school year and can make 
plans to ackbiess areas where they feel they need more woik. Smdcnts can also discuss their 
plans with their teacher and ctevelop a schedule of learning and instructioi^ activities through 
mutual agreement. Self-assessment measures of langua^ proficiency can take the fomi of 
questionnaires, rating scales, and checklists. 

Design 

The limited research on self-assessment of langu^ proficiency indicates that the more 
closely self-assessment measures relate to a student's reasons for using the language, the more 
reliable the infomiaiion becOTies (Oscarson, 1989). It has also been found that the type of ques- 
tions ased in self-assessments influence the size of the correlations between self-rating scores 
aiKi scores obtained on language proficiency tests (Baiiman & F^mer, 1989: LeBlanc & Pain- 
chaud, 1985). 

Items that are related to the stu(tent's purposes for learning a Uuigw^ should provide more 
reliable information than those which arc no. However, because the research on self-assess- 
ment of language jwofkiency has been conducted primarily with university studem^*, the find- 
ings may have limited application at the uRper elementary and middle gnKfc levels. Teachers 
should, therefore, review the results of self-as.sessment relative to inf(»rmation generated from 
other sources. 

One example of a rating scale for a self-assessment of reading ability is provided in 
Flgiire 4. Snidents arc given a list of reading tasks and asked to imticate to what degree they 
think they can perform each task. Selected reading tasks shoukJ be appropriate to the students' 
grade level and reflect the kx:al curriculum. 

F^ure 4 Self- Assessment tif ReiKling Ability 

In reading a passage, I can: 



Reading Tasks 


Criteria 


All the time 


Sometimes 


Almost never 


I . U iderstand the main idea 


,- ^ — — .-^^ — 


^ ^ ■ 




2. Understand the details 








3. Un<tersland the vocabulary 








4. Read quickly and still understand most of it 


1 
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One of the advantages of using self-asseNianent me^ur^ is that they can be administered 
individually, to groups of stutfents, or to all students in the class simultaneously. They can be 
conducted sA the student's leisure, perhaps on a bi-weekly basis, or whenever the teacher wants 
to get feedback trom students on their learning progress. 

Scoring scales for self-assessment measures depend upon the types of questions used, A 
three-point scale is illustrated in Figure 4, although some scales consist of as many as five or ten 
points. Intervals on a five-point scale might be described as follows: (5 points) I can do this all 
the lime; (4) I can do this most of the time; (3) I can do this about half the time; v2) I can seWom 
do this; and ( 1 ) I can never do this (LeBIanc & Painchaud, 1 985 ). 

Sdf-Assessment: Learning Strat^ 
Purpose 

Many teachers either implicitly or explicitly ask students to use various learning strategies 
in performing classroom assignments. There are a number of planning, attentional, self-evalua- 
tive, and stiKiy skills that teachetB may include in their cuniculum and guide students in using 
(Ellis & Sinclair, 1989; O'Malley & ChannH, 1990; Oxford, 1990; Rubin & Thompson, 1982; 
Wen Jen & Rubin, 1987), If teachers want to know whether or not students are using these strat- 
egies, they can ask them to reflect on their use by performing a self-evaluation. Students can de- 
scribe their strategies in dialogue journals or learning togs at the end of each unit. A learnmf> lofi 
is an ongoing reccHd kept by stiKknts to evaluate their own strategies for leammg, althKHigh it 
c*an also be used to reccml language ctevelo(Hnent and content knowledge. Laming logs emble 
stiKkrnts to iifentify goals they want to accomplish thnnigh learning activities. 

Design 

Students may be asked to indicate whether or not they asetl any special techniques to help 
themselves learn. The following strategies a^iear in ChamiH. O'Miilley. & Kii|:^ ( 199 1): 

• I paid attenti(^ to tl^ teacher. 

• 1 toc^ nc^ wten I listened. 

• 1 lotted at the questi(Kis before I read. 

• I took notes when I read. 

> I kx^ed at my nt^es after class. 

• I repeated new words aloud. 

" I used r^w words in sentences. 

Administration and Scoring 

Teachen* can provkle students wit'.i a weekly checklist to use for scU-assessmcnt and ask 
students to keep this information in a noteb(x3k. The checklist can also be placed in a student 
portfolio, and the teacher can add anecdotal mnes regarding student progress in the systematic 
use of taming strategies. 
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Summary 

P^ormance assessments are often used because they provide an opportunity to measure 
student performance across a range of skills and knowledge over time. Many peritmnance mea- 
sures are developed directly out of kx:al curriculum objectives and student peifwinance stan- 
dards ami, therefore, may be developed by tethers or other local staff. The perfcMinance mea- 
sures suggested above can be used individually, in combini^on. or adapted to meet 
devek)|Hnaital and language proficiency needs of stuc^ts. However, the use of multipk mea- 
sures can lead to proWems in reconikeeping and interpretation if teachers md other school staff 
lack ways of combining the information generated by them. In the following section, a frame- 
work for addressing these issues is presented. 

Portfolio Assessment 

Portfolios present a practical approach to assembling student work, interpreting evidence of 
student performance, and assessing sxvukni perfom^nce relative to iastmctional objectives. The 
conc^ of portfolios has beai %k^ed from the arts where students maintain evidence of their 
best worit to illustrate their accomplishments (Jongsma, 1989). In dassioom instriK^ion, portfo- 
lios are used in a similar manner, but the contents of the p<mfolio may represent woik in 
progress, formal products, and ratings or otfier evidence of student knowledge relative to specif- 
ic c^jectives or purposes (Valencia. 1990). 

There is no "right" way to design portfolios. Each classroom, school district, and state will 
reflect a unique approach to authentic a.ssessment, and in this sense, each student's collection of 
documents will differ somewhat, depending on the purpose of the assessment (Tiemey, Carter, 
& Desai, 1991 ). Creating and maintaining student portfolios require that a variety of teacher and 
staff decisions be msKie concerning the instructional goals or objectives to be assessed, who will 
be involved in the portfolio design and inten;»mtion, what instmments will be selected and 
how student perfomiance will be demonstrated, how portfolio information will be used, and 
how the nssults will be conveyed to others. Because the entire portfolio process can be complex, 
systematic review and evaluation of the f»ocess should be conducted on a periodic basis. 

Steps to portfolio develqjment shouW include designing the portfolio, planning for and 
collecting the necessary data, analyzing the portfolio contents, and using the results (Moya & 
O'Malley. in press). Each of these points will be described in the following sections. 

Designing Portfolios 

For the purposes of assessment, the material in a student portfolio is mast useful when 
each piece collected reflects prepress toward particular learning goals. To this end. portfoliiis 
can be designed following a multi-step process that involves: 

•setting the purpose of the portfolio; 

• focusing on specific learning goals: 

• identifying performance tasks and/or selecting appropriate instmments: 
•setting criteria: 

• selecting students to be as.sessed: 
•collaborating with other te»:hers and stafl': 
•conducting staff (tevclc^Jment: ami 

• involving students and parents in the portfolio development process. 
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Each of ttese sieps is discussed below. 



Purpose 

Befofe collecting any samples of siudeni wcMit, the firH step in planning a portfolio is to 
detennine the ixupose for conducting the assessment, and how the results will be used (Moya & 
0*Malley, in press; Navarrete et al., 1990). Will the results be used for making decisions related 
to classroom instniction? Will they be used to determine whether a student is ready to move out 
<^ a special English language support program, such as ESL, ESL-contait or bilingual educa- 
tion? WiU they be used to akl in assigning a student grade? Specifying how the results of die 
portfolio assessment arc to be used will assist in determining the goals to be a.ssessed and the 
samples of student woiit to be collected. 

Spec^ Focus 

The second jaep in portfolio design is focusing the portfolio on specific learning goals. 
Each portfolio should have a specific focus detennined by school staff. The focus may be on 
oral OT written language skills or on content area skills such as those required in mathematics, 
science, or social studies. Objectives may also be selected fwm goals contained in k)cal curricu- 
lum frameworks, state guidelines, program ob^tives, or consensiK among ESL/bilingual and 
mainstream teachers oHiccming important goals for learning. While it may be pos.sible to col- 
lect student work for all content areas as well as for English language skills in a single student 
folder, attempting to do this for purposes of assessment couW prove to be rather unwieWy. Pm- 
viding a focus, on the other hand, avoids having to go through an overwhelming amount of in- 
formation in each portfolio. 

Petfmnance Task/Instrument Selection 

Once learning goals and perfcmnance objectives have been identified, portfolio designers 
need to identify performaiK*e tasks and instnimcnts to be used to measure whether teaming 
goals arc being attained. Schoc^ staff should strive to combine traditioiml and peribrmance as- 
sessment measures in order to ^t multiple indkratcn?. of a snKknt s ability level. Standardized 
tests arc often required for district accountability needs. Using results obtained on standardized 
achievement tests togedier with anecck>tal records, rating scales, teacher observation ciiecklists, 
and writing samples to assess literacy skills provides much more informatics than .standardized 
test results alone. Furthermore, having muhiple indicators of .stiKient performance enabh^ 
teachers; to cross-check one type of information against anotlter. 

Each portfolio should also contain items which are required to assess progress on particu- 
lar instructional goals and other^i whicHi are of^ional. Required items might include tlwse which 
arc necessary to communicate a student's pix>gicss to otter teacher?; or to administrat(H>i and can 
include a .student's "best work," white optional items could include drafts of wwk in prepress, 
ongoing ratings of performance, and occasional pieces selected by tlte student (V^iKia 1990). 
The m: of required items intitxluces an element of consistency in the evaluaticxi of student port- 
folios. By making certain items obligatory and others optional, teachers ^ the infomiatton they 
need fw making instnKrtional decisions white also encouraging students to participate actively 
in portfolio design and use. 



Setting Criieria 

Teachers w school staff should cktennine criteria (perfcMinaiice staiKlards) for interpr^ing 
poitfolio contents before coltecting any student data. Performanoe critma must be established 
in cHdo- to determine the degree to which a student has attained the ob^vcs eadi t^l^^ 
moit is designed to assess. Teachers need to idaitify ami establish a minimum number of spe- 
cific objectives tfial illustrate attainment oH the instnK:tional goals. One way to set criteria is to 
require stuctenis to perform tasks either inctependenily «• with assi^ance. Another possibility is 
to define expected stiKient performance in namoive anecdotal fomt The narrative can specify 
what the stuctents should be able to ck) to meet the criterion for peribmiance or growth over 
time. 

SU^CoUabontion 

If pcHtfolio assessment is to be undertaken by a school-based team, it will be essential to 
identify school staff willing lo participate in the assessment process. Ideally, a cross-section of 
teachers, staff, and administrators at each school who serve the same stude3it(s) could become 
members of a pwtfoUo assessment team. For exan^jle, a team at the upper etementaiy levels 
might consist of an ESL or Wlingual education teacher, the gr»fc level classroom teacher, a 
reading specialist, and the school principal. At the middle school level, the team might consist 
of a stucteni's ESL or bilingual education teacher, content area leachers, and peihaps the school 
counselor. If poitfolio assessment is a totally new experience for school staff, it is probably a 
good idea to pilot test the apjmiach with a small number of staff and students before using it on 
a school-wide ca- district-wide basis. 

Staff Development 

All staff involved in the pcHtfolio process shcHild receive infonnalion and training on how 
to plan, implement, and interpret portfolios, especially when portfolio a-ssesmiait is to be con- 
ducted at the school-building or district-wide level. Staff preparatitm not only enables staff to 
collaborate with and support each other, it also buiWs critical support for the pwtfolio process it- 
self. Staff should receive training cm how to design portfolios, how to taiget specific teaming 
objectives and select snidents (if portfolios are limited to only a part of the snident population), 
and how to set criteria for each portfolio. Staff ctevelopment will also be essential to planning 
individual portfolio contents and to designing, administering, and scoring holistic, perfomiaiKe- 
based measures such as oral interviews, teacher d)servation checklists, rating scales, and writ- 
ing samples. Performance and portfolio assessment hoW great iaxMnise for improving assess- 
ment, but they can only resKzh their potential when teachers master their use (Stiggias, 1990). 

Stu^nt Selection 

Ptortfolio teams or individual teachers need to consider several factors when deciding 
whether to implement portfolio assessment with one or more students. If the classroom t*^acher 
is acting on his/her own to gailKr ttie infonnalion (without any support from other school staff), 
initially it may be advisable to limit the number of portfolios to only a few students. This can 
prevent teachers horn being overwhelmed by the data collection and analysis effort and giving 
up before experiencing the benefits of portfolio assessment. Oi the other hand, if portfolio as- 
sessment is to be a school- or district-wide initiative, and if more than a few teachers are going 
to be involved ami provided staff development in its systematic implementation, then many or 
all students can be included in the procedure. 



Questums to ask regardii^ which students will participate in the pcHtfolio pitx:ess are: Will 
the pcHtfoIio be used in only one ciassroom? Will it be used only with ^udoits participating in a 
particular program (s(K:h as ESU bilingual education, or Chapto' 1)? Will the process be limited 
to a single or multiple grade tevels? Will all imidents in each classroom be assessed using a pott- 
folio? Will the procedure be limited to only those individuals needing fiequent monitoring? 

SUukntfPmvnt Invotvement 

The teachor and/or pwtfolio asse^anent t^um shtnild encourage die active involvement of 
both students and parents in the assessment process. A key element in portfolio assessment is 
student self-evaluation. StiKients are asked to reflect on their {m)gress toward learning goals and 
encouraged to select samples of their work whic-h they believe illustrate progress toward these 
goals (Baron, 1992a; ftihner Wolf et al.. 1992; Tiemey. Carter, & Desai, 1991 ). Teacher/student/ 
parent conferences can be scheduled at times convenient for the parents so that they can be in- 
formed their child*s progress. Portfolio contents provide much more infcmnation to parents 
about their chikl s learning than the percentiles reprK^oited on standatxiizsed achievement tests. 
Furthermore, parents appreciate being givai an of^XHtunity to respond to example of student 
work, particularly items that show progress and substantiate grades given to the stiKlent. 

Planning for and Collecting the Data 

Data coltection for portfolio ass^isment consists o( ictentifying information to be entered 
into the portfolio, determining the freqi^ncy of data collection, creating a system to record and 
monitor the frequency of data collection, and setting gukklines for the removal arxl updating of 
portfolio material. These gui<felines imy \ary diep&tdmg m tt^ purpc^ of the portfolio. 

At the elementary and mickUe school levels, portfolios can be updated on a semester basis 
or at each grading period. Some schools arc experimenting with portfolios which present in- 
creasingly comprehensive information on students by beginning with an initial portfolio every 
nine weeks, a semester p(»tfolio drawn fn^n tl^se, and a year-eiKi pcntfolio (PalnK:r Wolf et al., 
1992). However, if the purpose is to closely mc^iitor student progress, assessments shouki take 
place af^ximately every four to six weeLs. Occasional items can be placed in the portfolio on 
a more frequent basis and removed when they have been superseded by more recent worit or 
have become redundant The decision to remove or maintain portfolio materials is a collabora- 
tive (K1C to be m^ between the slucfent and the teiK:her. 

Analyzing Portfolio Contents 

To determine whetl^ a portfolio's contents reflect a ^intent s progress toward k^aming 
goals, tl^ teacher or portfolio assessment team can match contents to specific learning goals and 
cb^iives on a cover f^Kst, as illastrated in the Sample Pt:»tfolio Analysis Fomi in F^re 5 
(^iapted by Pierce from Moya & O'Malley, in jHiess). Note that student ob^tives are placed in 
the left-most column of Figure 5, followed by illustr^ons of i^mtent progress, aiKl a jqiecific 
citation or page refererKre to materials that support each objective. When £Kklitional evidence of 
student progress for ea:h ob.^ive is entered or fcHUKl in tl« pcMtfolio. relevant jxigc citations 
can beackled. 

Summary cxNnments, interpretations, and recommernkticms can be adffed at the bottwn of 
tl^ PtMtfolio Analysis Form. TlK:se anecdotal notes help interpret arxi integrate tte results of 
stucfent performarKre %nioss various measure or skill areas. Forms such as tlrc om in Figure 5 
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F^ure 5. Sample Poitfirfio Analyst Form 



Student: Marfeg/A Date: 5/7/92 

Teachen Jone& Grade: 4 

Educati(Mial Goal: Btu^ient jjierru^trstes ahl^ 



PetfiH'iiiaiice T^k 


Contents Illastrating 
Student Progress 


Date 


• Demon&trates interest and 
ability in 0 variety of writing 


Literacy Peveiopment Checklist 


3/20/92 


• Writes a short story 


Writing Sample: Doq Story 


4/22/92 


• Writes to communicate v^ith 
others 


letter 

Dialog Journal 


4/10/92 
3/51/92 


• Expresses writing preferences 


Self- Assessment of Writing 


4/24/92 


• Shares writing with others 


Anecdotal Record 


4/6/92 


Summary Comments: 



offer sevend advantages: teachers can indicat 5 the relationship between each item in the portfo- 
lio and the objectives being assessed; they can inoke specific suggestions for instructional adap- 
tations to studoit needs; ami they can sift through portfolio contents periodically to remove ma- 
terials that, althou^ interesting, have no use in evaluating student progress. 

To determine how stuctents acquiring English as their second language arc progressing in 
comparison to otho- students, performance assessments can be administered to native or profi- 
cient English-i^ieaking grade-level peers in mainstream classes aiKi average ratings calculated 
for these stiKlents as well as for tl« English language leamens. Administering any of the perfor- 
mance assessments described in this publication to a locally selected, "averagic" group of 
English-speaking peers will povide tlw most meaningful basis for comparison. This will inform 
the teiK:her regarding both the English learner's jwogress and his/her preparation for functioning 
dX an iiK^ieiKfent/average level in a typical mainstream cla^^room. 

Using F6rtfolH> Results 

There are a variety of ways in which portfolio results can be used. The Sample Portfolio 
Analysis Form shown in Figure 5 Is an essential component in many of these uses: 
• diagrufsis and pliH ement—sludcnl strengths and needs arc examined with regard to major cur- 
riculum objectives; 

•monitoring student pmgress— growth in learning over the course of the semester w school 
year can be monitored; 

•feedback on the effectiveness of instrm tim — if individual stuctents are not progressing, the 
instnictional approach should be re-evaluated and a^^Tropriate ^iapiations made to meet e£K:h 



.Oudou's veeds. One possible conclusion is that a student nee<^ instnictional supp«t beyond 
the services {Mwided by the clasaoom(s) in which the portfolio has bean maintained; 

• communicatim with other teachers— ihis includes other numbers of the portfolio team and 
those at odier schools to which stuctents may tramfd; 

• student feedback — portfolios ei^ble students to comment and reflect on their [»t)gpess and 
plan what they would like to do to maintain or change it; and 

• amimunivatioft %iith po/iew/s— portfolios provide pan»its with concrete evidence which sup- 
ports in^HK^ticnial decisi<»is. 

Pbrtfc^kis in Practice: Some Common Concerns 

As a result of comlucting woiiudiops with teachos and administrators on portiiHio assess- 
ment, it has been our experience tlmt, while the use of portfolios has many advantages, it is not 
without its limitations. In this section we will describe some of the more commonly ickntified 
ob^les to inqTlemoiting portf olios and suggest procedures for overcoming them. We will also 
look briefly at how portfolios have been used in some states and schocri districts and as part of 
ESUbilingual progFank> to gain iasights into real problems and possible solutions. 

"PortfoSi^ take too much time.** 

Te£K;hers and administrates frcqiKmtly exf»ess coiK^ems that designing and using portfoli- 
os arc time consuming processes. This is commonly expressed by teachers in the initial stages 
of portfolio assessment, but af^iears to become of lesser concern as teachers begin to establish a 
classroom environment that oicourages students to be iiKreasingly independent and responsible 
for assessing their own progress using portfolios (KoUs, 1992; Tiemey, et al., 199 1 ), 

There are several ways to reduce the time involved in implementing portfolio assessment: 

( 1 ) make the data collection part of daily instructional routines; 

(2) make students responsible for collecting infcmnation on a regular basis; 

(3) identify specific items that go into the ponfolio and list them on a portfolio analysis fcMm: 

(4) initially, use portfolios with only two or three students who need intensive monitcmng; 

(5) use staggered data collection cycles wtere assessment data are collected from only a few 
students daily or weekly; 

(6) share responsibilities of data collection and interpretation with other school staff so that indi- 
vidual teachers do not become overwhelmed by ^ process; and 

(7) create common planning times for teachers and t^her staff involved in portfolio develop- 
ment. 

"How do we decide what goes into the portfolio?'* 

The teacher or pwtfolio assessment team ctelermines the ccMitents of each portfolio by 
identifying learning goals and specifying minimal levels of stuctent performance that slww 
whether stucfents lyive attained these goals. Instruments arc then selected for eliciting the de- 
sired student performance and criteria set for detemiining performarK-e levels. 

"How do we interpret the contents cf a pwtfMf?" 

A major concern in portfolio assessment is what to do with portfolio contents once they 
have been collected Prior to attempting to interpret this information, the teacher ot portfolio 



assessment team should identify teaming golds, stiKient perfonmoK^ levds that demonstrate 
attainm^ of these goals, the tasks or instrumotts to be used to didt student pe^ 
criteria for detemiming student {mjgre^ and whether specific portfolio items will be required 
oroi^ional. Next, the teacher (x assessmeiH imn must determine how nuidi weigitt to give 
each item in the portfolio. As with the portfolio de«gn process, guidelines for interpreting port- 
fdio results should be established in advance of data collection. 

**How are otiiers usu^ petfiamance'-based assessnunt and portft^os?'* 

Most of the portfolicK in practice that we know of in language arts, ESL, and bilingual pn>- 
grams are used to assess literacy skills (see Fl^iire 6), We know of few which focus on content 
area skills or oral language profici«icy. In Figure 6 we fHovide a sanding of contents suggest- 
ed for reading/writing portfolios by two ESL programs in two school districts in Virginia (Ar- 
lington and Fairfax) and two language arts progran^ in one county in FUxida (Oran^ County) 
and one elementary school in New Hampshire (Stratham Ntemorial School). 

What becfxnes immedialely evidait from Figure 6 is that while Arlington County and 
Stratham Memwial School distinguish betwe^ reading and writing »itrks. Orange and Fairfax 
Counties indicate anv (required) and (^tmai itewK, as we have recommended in this publica- 
tion. In addition, all of the pcmfolk)s indicated in Figure 6 incorpc^ate many of the items we 
have described in this publicaticm, incliKling test results, lists of books read, writing samples, 
learning logs, leadingAvriting checklists, and student self-asnessm^its. 

At the state level, more and nMsre states are moving to performance as.sessment to easure 
that students graduate with more tt^i basic skills and to get a more ccmiplete picture of stu- 
dents' abilities. A 1990 survey by the Center for Research m Evaluation, Standards, and Stu- 
dent Testing (CRESST) at the Univer^ty of Califomia-Los Angeles found tlmt neariy half of 
state testing {Hiograms either had performance as.sessments already in place, were planning to 
implemeni them, or were expksing their use (O'Neil, 1992). During 1990-91 the State of Ver- 
mont piloted the natiwi's first statewide portfolio assessment, which focased on mathematics 
and writing in Grades 4 and 8, The Vermont fHoiect was ctesigned by teachers and fully imple- 
mented in 1991-92. It involves teachers in reviewing the actual classworit of students. It is im- 
portant to note that major emphasis is being given to staff devek)pment and buiMing resources 
that suf^port portfolio as.se.ssment implemenlation efforts (Vermont State Department of Educa- 
tion, 1990). 

In Cwinmicut, the Stale Department of Education has developed the Connecticut Com- 
mon Core of Learning A.ssessmcnt Project in Science and Mathematics to design perftMinance- 
bascd as.scssment tasks for high school students tha! can be ased by both te«:hers and policy- 
makcTs to determii^ what students know and can do. This is a tow-.stakes pro^ (the results are 
not being used for student promoiicHi or graduation) which allows Connecticut educators time to 
examine their curricular, instructional, and asscssr^nnt strategies and bring them into cloj;er 
alignment with tin: new vision of science and mathematics education (Baron, 1992b). 

In Kentucky, a state school reform mandate calls for tl» impianentation of the nation s 
first completely perfomiance-based statewide assessment syj^emliy 1995. The system, which 
has already begun to be implemented, will rely heavily on teacher asses.sment of student perfor- 
mance at Grades 4, 8, and 1 2. The .statewide assesanoit system will have three components: an 
acccNUital»lity assesanent arKl two voluntary »«essmentv— fcmnal wd infomial — of sliMtenl 
progress in classrooms. The state calls for teachers and other school staff to collect .student per- 
fwmance task results in an "accountability portfolio" (Rmhman, 1991 ). 



Figure 6, Reaiyng/Wrdiiig PdrtfoHos: Sample Contaits 
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•Teachcf c*Kcrvaiw»i log 
•Exampks of wh*H siiKtent can rcs^ 
•Bodes/materials rcsd 
•AiKik)Uipc of siud^t reading 
•TeM nsHulls fcmnal md infc^mal 
•Ccmfercncing fmns 
•Exampks <^ skills ira^eml 



•First piece of writii^ eadi >«ar 
•Learning log, dialog ^^mmal 
•Jmimy and May writii^ samples 
•Drafts and final prodmns fnm dilTenLMit gouxrs 
(p^HoiuU mimives, expc^ticm, liters poems 
^says fcpcHis) 

•Grafrfucs (illustratiims, diagrams) 
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Favcmte bixiks/autlK^ list 


•Writii^ sample and cover 


•Gcrae gra}^. imlicating type of iiteralua* 


•List of ctnnpleted pkxcs 



•Journal entr^s 

•List of completed hocks 



Evabmtim 

•Goals and/cH- self-evaluation 
•Annual iwndive suirumiy stuckmi 



•Re^KUng Development ClKcklist 

•Three writing samptes 

•List of hiK>ks read independemly 



f^^imudl EkmetOs 
•SttKfeni seif-as^ies'mftent 
•Reading jpumals 
•Audiotapes of student remiing 
• Things I Can Dei" List 
•Test nrsulls^ fcmnal and infixmal 
•Readily comfm^l^nsion tests 
•Running reccMxls (misct^ analysis) ami 
amx(k)tal recnmls 
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•Two writing samples 
•Two oral (mxluction 5^mples 
•Infcmnal leading asseisnKrnt 
•I jsl of bixAs ra^ 

•Results of Degrees of Reading Power 
(DRP) test. Grades 7 -12 



O^mmlEkme^ 
•CMatogi^ jmimal exceqMs 
•Tem-lier observaticn^ 
•Rei^ng/writing ct^'klisls 
•Student self-asse?ivmenl 
•AudicVvidecrtapes 
•Stuikni-selecled work 




Summary ami ConduskHi 

School-based student assessment piYicedures are begiiming to change to keep pace with shifts 
in instructional panKiigms. As instiiKnion for language mimnity students has moved in the di- 
rection of teadiing Imiguage and content-area skills in context, assessment has begun to incor- 
porate a wido- vffliety of measures that more ck)sely rerkct the types of tasks thai students are 
asked to perform in classrooms or in real-life saiings. fai this sense, school-based assessment 
procedures are becoming more authentic. Chai^ in assessment are especially important for 
language nunority students and those acquiring English as their second language. 

In addition to shifts in sdiool-based ass^sment practices, state arni national ediKalion initi- 
atives are moving toward higher standards of student perfonnaiK:e and school accountability. 
Whether or not students and schools arc prqpared to meet standards will depend upon the namrc 
of the standards, whedier students are being agisted in meeting them, and what instruments are 
used to measure student progress. Clearly, these shifts toward higho" perfonnance stancterds will 
have an im^nct on language niinmty studoits. 

To be able to effectively monitor the prc)gress of language minority smdents, assessment 
needs to be conducted on an ongoing basis with procedures ttuu promise to yield the most use- 
ful infomiation for classroom instruction. While standardized achievement tests canm^ provide 
this type of information, perfomiance-based asses^nent can. Performance tasks and instruments 
must be carefully designed, administered, and scored by tKK^e^ or asse.ssnient teams who have 
been trained on the assessment procedures ujied. hi addition, performance criteria need to be set 
and raters trained on appropriate scoring procedures to ensure the rcHability and validity of 
results. 

Pbitfolio assessment has the potential fcM- becoming an effective maiagement system for 
performance assessment results. It represents a focased assessment of learning goals or objec- 
tives in English, native language arts, and/or the content areas. It can be conducted on a class- 
room, school-wide, or district-wide basis. At all levels, specific steps are reconunended for im- 
plementing portfolio assessment, incliKling: identifying the puipose and focus of the 
assessment, designing the pcmfolio, collectir^ data, analyzing portfolio ccMitents, and using 
analysis of the results to make adajKations in iastruction. 

In this publication, we have addressed how perfonnance and portfolio assessment can be 
used to monitor the classroom jm^ress of upper etementary and mickile school students. Portfo- 
lio assessment has the potential for being ased in other ways, as well, such as: 

( 1 ) For students who are moving from one tescter or school to another, portfolios can be 
used to pass along critical information on their strengths and neccfc so that the new teacher does 
not have to duplicate assessments which have already been comlucted; 

(2) For smdents who are being considered for placement at diflerent levels within an ESL 
or bilingual education f»x)gram, portfolio results can be used to determine their ability to func- 
tion at various levels; 

(3) For students who are being consi(tered for transition from an ESL or bilingual edmi- 
tion program to a mainstream, English-only pn^ram, portfolio results can be ased to measure 
performance relative to grademates in the mainstream; and 

(4) For stucbnts who are being considered for prereferral to special education progranLs, 
portfolio results can be ased to determine whether performance is related to language proficien- 
cy, including both native language and English literacy skills. 
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PntfbUo assessment is cunendy being iKed Ofi a lu^^ 
pionentation with lai^u^ minority student and Engli^ language leamos in schcml distikrts 
and stales throughout the countiy. A laige number of te«:hers and staff, white valuing the nature 
of the infonn^ion generaied by studoit potfoUos, neveitheless feel that the consuaints placed 
on their time wd resources by pratfdio ass^anont prechide i^s ise on a regular or expanded 
basis. We have discussed some of the concern expressed by practitkxiaTi said have made a few 
sug^^KKVi forov^Gfflning tlion. Key to ackhessing cmcm^ abovs. pcHtfolios are an »lequate 
program of staff development and oppominittes for teadier collaboration in ptoming md col- 
lecting stud»it performance samples. hope that teachers md school staff continue to share 
with us their successes and failures in in^>lementing poitfblios as we move toward gathering 
more information on this innovative asses»iient approach. 
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